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ABSTRACT 

This paper reports a model of the impact of teacher 
behavior on student achievement. Estimates of the model's efficiency 
are obtained and its utility tested on a second set of data. 
Methodological and theoretical frameworks are from sociologists 
interested in contextual affects phenomena. Data were collected from 
374 students during 1971-73. Using standard regression procedures, a 
model was constructed of the relationship between teacher behavior 
and student outcomes for 1971-72. The model was verified on 1972-73 
data. The findings are ambiguous. The first year model is 
satisfactory as a post hoc predictor. It is less satisfactory applied 
to the second year data. The methodology, however, is an advance for 
the study of the consequences of administrative behavior on the part 
of teachers. (Author) 
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behavior* 

Thft appropriate models then, should describe tsuch more than osan 
differences between roocui* It should also describe the effects of various 
dimensions of teacher behavior on individual student outcomes while at the 
same time considering the characteristics of the individual sttident. To do 
this requires a nodeliog technique capable of handling individual and 
classroom level variables simultaneously. agression analysis, which is the 
most general form of the analyf is of variance as commonly used In eJucational 
research, meets these specifications. 

There are good reasons for researchers to be concerned with the unit of 
analysis issue-*particularly the level of aggregation on the "output" side 
of the equation. First, mult 1- level analyses of the schooling process 
correspond to our general iiq>ressione of what the classroom teaching process 
is all about. Second, to study only classroom means is to Invite misleading 
ansi^rs. 

To illustrate the latter point we draw on a paper by Rosenshlne and 
Furst (1971), "Research on Teacher Performance Criteria." In their attempt 
to synthesize some of the research teacher effectiveness, the authors 
utilize the rubric "process-product" studies to describe . . investigations 
which attempt to relate observer! teacher behaviors to student outcome 
measures*" These stuules are correlational in nature. 

The correlational studies cited by Rosenshlne and Furst appear to be 
based on classroom means. A teacher behavior is noted, mean classroom 
learning Is computed, and correlations between the teacher behavior and mean 
student learning are calculated over a sample of classrooms* The correlation 
(squared) can be interpreted as the amount of variance in ^Saean" learning 
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L. IBbtroductlon 

In this paptr w« will examlM thrM procedures that educatijoal 
researchers can use to analyae quantitatively 'he extent to idiich aodifi** 
cations of specific teacher behaviors lead to changes in pupil achieveaettt* 
This is not a slaf^le task. It requires decent descriptions of the behaviors, 
appropriate statistical tools and aeaaures of student outcome that are 
vorthvhile exaainlng. Our data, collected in the course of an evaluation of 
the relationship betveen the organisational structure of schools and atvidettt 
a.AhieyeMnt» is not entirely appropriate for the issues ne wish to deal vlth 
in this paper. Therefore ve can only suggest paths that this research night 
take in the future. 

Our aajor arguoents are as follove: 

1. It is posslbiis, using multiple regression analysis, to construct 
Mdels of teacher behavior that reflect the view that sooa set of teacher 
behaviors affect student outcomes* 

2. These models can be applied at least three distinct vays, depending 
on the kinds of assuoptions that one Is williaf to aske about the data and 
the kinds of qu'ssstions that one vishes to address. 

Pollovlng a brief description of the saaiple and neasureMnt instrunents 
ve will exaolne each of these issues in turn# 

II# Procedure 

a) The Satnple 

The schools participating in our study are located in a suburban 
cosanmlty. The school district is racially Aixed (approximately III black) 
and represents a range of socio-economic backgrounds. As a consequence of 



i£ Mgrtgatlon, aost of th« tchoolt «r« fairly hoMotmaoos on both 

racial and social class indices* 

A sample of 14 fifth grada classrooBS vas chosan fros savan of tha 
alaoantary schools in tha district. Tha classas tiara salactad to rapraaant 
both a varlaty of social class backgrounds and tha spactrun of claaarooM 
organisational atylas. Quaationnairaa vara adaiolatarad to tha studanta 
in thasa roons on thraa occaaions. Tha data for tha analysis of atudaot 
outcooes in yaar ona is takan fros tha flrat t«o adsinlstratioos of tha 
quastionnairas, Saptavbar^ 1971» and Itay, 1972. Tha analyaia of tha aacond 
yaar data uaas tht tast acoraa collactad la May, 1972, aa pra-taat s^afitras 
and thosa collactad in May, 1973, aa post-tast scoraa* 

Aa iil.th Mbat longitudinal atudiaa thara vaa aoaa attrition dua to 
atudants aoving out of tha district, illnaas, ate* Our final aa^la CH-187) 
Included only thosa rcudants for uhos thara vas coop lata data on all 
variablaa. Several aquationa vare run vith less strlogeat requlroMnts, but 
they do not differ in any significant vay fro« thosa reported in :;hia paper* 

b) The Measures ^ 
!• Achievaaant 

Tha achiaveiBsnt ueasura selected for use In this study vaa wHth* Tha 
arithMtic scale consists of 36 iteaa tnm tha CTBS testr of Cos^utatloa, 
Concepts and Applicatlona. 

ii« Affacdva Outcooss 

The current trend In the educational literature is to attend not only 
to the strictly cognitive outcoaes of schooling, but to also consider 

^Other Deasures of cognitive and affective develop«ent vere collected 
for use in the original study* They are not included in tha present analysis* 



outcoMS that «r# mote appropriately coaaidarad affactlva^ 

A aaaaura of aatlaf action vith school ^ adaptad froai Bra>fiald aocf 
Rothe'tf (19!)1) Index of Job Satisfaction, %^as adalnistarad to tha atudanta* 
With appropriate ndif Icatioos in tha vording of tha ItMa, 8 of tha 
original 18 itasMi vara iocludad in tha flcal acala. Tha othara vara delated 
because of lov factor loadings and/or the difficulty of traaalating the itea 
fron one context to another* A factor analysis indicated that the ei^t 
iteaa loaded on a single factor* 

ill. Teacher Behavior 

A queatlonnaire^ adapted frosi Schafer^s (1965) Chlldren'a Report of 
Parent Behavior Inventory, vas adeiniaterfid to the studenta to aaaesa their 
perceptions of their teacher's behavior.^ The adaptatlona consisted of 
deleting Items that did not pertain to a claaarrooei aenting and changing the 
word "parent" to "teacher" in those itena that vere appropriate* Following 
a factor analysis of the firs^ ro\md of data, 34 Iteea vere retained for 
inclusion in the remaining adulnist rations of the scale* Thirty of these 
items loaded on two factora that ve call Carping Criticism (cf* Henry, 1963: 
302ff.) and Warmth* The regaining four items conatitnted a third factor, 
Freedoai or Autonomy* On the assunvtioo thmt students vould require some 
time to develop stable perceptions of their teacher'a behavior, the meaaurea 
of teacher behavior are derived froQ the May, 1972, cdminiatration of the 
Schafer acale year one and the May, 1973, administration for year tvo* 
Individxial perceptions of teacher behavior vere averaged over all students 
In a room; the resulting a^sasure vaa uaed as a description of teacher 
behavior for that room* 

^In addition^ student observera vere trained in the uae of Soer*a (1966) 
achedule of teacher behavior* The observational data la not Included In thia 
analysis* 
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Schtfer reports oa the validity and reliability of the original scale* 
In our own analysis, the cooountfllty estlisatet from factor analysis aerve at 
lower bound estimates of reliability and construct validity. The 
coaffiilents are comparable to those obtained in other studies that have 
Ltsed factor analysis as a iseaas of validating instruiatnts (e.g.^ Punch. 1967). 

Ill, Devising an Appropriate Model 

In general^ theories about teacher effects state that teacher behavior 
affects the acadenlc performance of students* Fro«i tnis very general vlev» 
ve feel that the appropriate test of whether or not (or to what extent) 
teacher behavior does affect children is to consider a nixed level analysis; 
individual student background Masures are exaaiined io conjunction with 
agRregate sieasures of the classroom environment (teacher behavior) la the 
production of individual student outcomes. 

Economists refer to the problesw related to changing levels of analysis 
as problems of aggregation (when individuals or groups are lumped together) 
and dis-aggregatlon (when they are separated). In sociology » the seminal 
treatment of the problem appears to be Robinson's (1950) paper on '"Ecological 
Correlations and the Behavior of Individuals**' The authors of the OEO Report 
( Equality of Educational Opporturtltjr ) do not deal directly with the lav^l of 
snalysi4 issue. The design of their study, however. Indicated an avareness 
of the need to employ multi*level models in the analysis of the schooling 
process, Coleman et al* refer to the design as a "tw level" regression 
analysis. We found no systematic treatment of the problem in the education 
literature; ve are fslrly certain that the particular methodological issue 
does not play a large part in the design and reporting of studies of teacher 
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behavior. 

The appropriate model, then, should describe truch more than oean 
differences between roomd. It should also describe the effects of various 
dimensions of teacher behavior on individual student outcotnas while at the 
same tiine considering the characteristics of the individual stodeat. To do 
this requires z modeling technique capable of handling individual and 
classroom level variables simultaneously^ agression analysis, which is the 
most general form of the analysis of variance as comnonly used in eJucatiooal 
research, meets these specifications. 

There are good reasons for researchers to be concerned with the unit of 
analysis issu^-^particularly the level of aggregation on the "output" side 
of the equation. First, multi-level analyses of the schooling process 
correspond to our general impressions of what the classroom teaching process 
is all about. Second, to study only classroom means is to invite misleading 
answers. 

To illustrate the latter point we draw oo a paper Rosenshine and 
Furst (1971), 'TleseaTch on Teacher Performance Criteria." In their attempt 
to synthesize some of the research stu teacher effectiveness, the authors 
utilize the rubrir "process -product" studies to describe ". . . investigations 
which attempt to relate observed teacher behaviors to student outcome 
measures." These stiujles are correlational in nature. 

The Correlational studies cited by Rosenshine and Furst appear to be 
based on classroom means. A teacher behavior is noted, mean classroom 
learning Is computed, and correlations between the teacher behavior and mean 
student learning are calculated over a sample of classrooms. The correlation 
(squared) can be interpreted as the amount of variance in 'Snean" learning 
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associated with variance in teacher behavior* A correlation of .70 ^etue^^n 
teacher clarity and tnean pupil achievenient » irtdicates that 491 (•70^) of the 
between room variance in student achieveiaent is attributable to teacher 
clarity. However » if only 20Z of the variance between students ia attributable 

o rootna, then only 9.87> (.49 x .20) of the variance in individual outcotna 
scores is attibutnble to teacher clarity* In correlational teras^ the 
coefficient would drop from .70 to *31 ( V.098 ) by changing froa roocoa to 
students as the unit of analysis. Statistically significant or not» such 
small relationships would probably not be regarded as itapcrtant by 
practitioners faced with the task of improving the scores of individual 
students. Very simply, using classrooms as the unit of analyala will affect 
the value of correlations between environiaental variables And student outcoosea^ 
usually resulting In over-estimates of the site of environtaental effects. 

IV. Uses of Regresstor Analysis 

The choice of regression analysis does not completely resolve the 
methodological Isrues involved in modeling teach*»r behavior. As Coleuao (1972) 
notes in his provocative paper, "Integration of the Social Sciences through 
Policy Analysis/* there are at least three different ways in whfrh the icchalqua 
can be used. 

Coleoian reviews the various approaches, with particular emphasia on tho 
assumptions that underlie their use* Briefly, these include the use of 
regression analysis (1) to estimate the parameters or coefficients for a well 
specified model with known structures; (2) as a technique for uncovering tha 
causal structure in a set of variables when some prior assumptions can be made 
about the causal relations an^ong them (path analysis); and (3) as a procedure 



for partitioning the regression l am of aquAres in insraricea where no ^usal 
model can be specified and errors of measurenient and collnearity are thought 
to be prevalent. It la apparent that each of these successive uses of 
regression analysis requires leas stringent assumptions about the structure 
of the proposed model aivJ the crudeness or sophistication of the measures 
employed. We will examine the use of methods one, parameter estimation, ond 
three, variance partitioning, in the analysis of teacher behavior and student 
achievement* 

a) Partitioning of Variance 

The use of variance partitioning procedures requires relatively fev 
assumptions about the structure of the linear regression codel. In fact,, 
all that one need assume la that the direction of "causality" is from the 
independent to the dependent variables. (Coleman, 1972) The crtxlenei^s of 
the measures generally employed In educational research is a rationale for 
adopting variance partitioning techniques. Mood (1971), for instance, groups 
the variables he works with into broad factors on the assumption that the 
individual measures that he ecsploys are first, inaccurate (measurementwise) 
and second, are only proxlfjs for the variables thi't he la considering* 7or 
Instance, he subsumes under t^ie general factor of *'peer quality" such 
measures fis parental expectations for higher grades, hcurs of homework, plana 
to go to college, etc. Alao, for researcherf concerned with the location of 
bases for implenencing change in educational institutions^ variance 
partitioning techniques are useful ror identifying independent (orthogonal 
or uncorrelated) factors. 

The purpose of variance parritioaing is to determine what part of the 
explained variance can be attributed "uniquely" to each of the independent 
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varlables and that part which ia due to colioearlty amoag the Independeat 
varlablea. One way to conceptualize the procedure is to regard It aa an 
attempt to first , estimate the aoouaw of variance in a dependent variable 
iihich is attributable to an independent variable over and above the variance 
attributable to other variables in the aet, and second, to estimate the 
aoaount of variance in the dependent variable vhich is shared amoag the 
predictors. 

Our analysis is based on the procedures outlined by Mood (1971) , 
although interested researchers should Investigate corspeting techniques used 
by Astin (1970), Ward (1963), or Newton and Spurrcll (1967). The following 
iKxiels are required: 

(2.1) (m^ « f (S£j+I3Vii^> 

where: S^j is 1 if student 1 la In room J, 
zero otherwise, 

ISV^y^ is the score for student 1 on 

background variable k, 

Oin.'^ is the outcome score for student !• 

(2.2) OUT^ « f (^^ik^ 

(2.3) OUTi - f(S^j) 

(2.4) Ob:^ « f CKrBAj4KrBBj"+HrBCj) 

where: MTBA^ to MIBCj are the classroom average 

scores on the three teacher behavior factors 
for the teacher in clasproom j. 

(2.5) OIJT^ *^ f (hfrBAjWBBjWrBCj-^IDVi^.) 
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Hodcl 2.1 is referred to as a "fulT' oodel; it represents all 
differences that exist between roooas as well as the student background 
char-.cteristics. Model 2,2 places a restriction on the full model such that 
differences between rooms are assumed to be zero; student " are 
predicted solely as a function of individual background cu^v jcterlstlcs. 
Model 2.3 is the multiple regression analog of a one-way ANOVA. It attempts 
to explain differences between Individual student outcomes in terms of 
unspecified differences between rooms. Model 2.3 signifies the upper limit 
on the amount of variance In the outcome that can be explained by an^ «ort 
of variance in the classroom context. Assuming that this variance is large 
enough to be of interest, the researcher may wish to know how much of the 
variance in the outcome can be attributed to his particular measure of the 
classroom environment. This estimate is obtained by replacing the I's in 
model 2.3 with measures of the classroom context, resulting in model 2.4. 
Any difference in the predictive efficiency (RSQ) of models 2,3 and 2.4 
indicates the extent to which the replacement measures do not fully represent 
all differences between rooms in terrna of the d*?pcndent variable. Model 2,5 
predicts student outcomes from knowledge of specific teacher behaviors and 
Individual background data. The reduction In explained variance from 
model 2.1 to model 2,5 Is a further Indication that the teacher behavior 
measures do not fully nccount for the variance attributable to the classroom 
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Results 

Table I contains the means, standard deviations and correlations for 
the variables employed In the study. 
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Model 2.1 (Table II), with all of the variables included, accounts for 
approximately 737. of the variance ia math achii^venent. A comparison of 
model 2.2 with cx)del 2.1 indicates that only 6.2X of the total variance can 
be attributed to differences between rooms over and abov^ differences 
associated with student background characteristics. Indeed, under ideal 
circumstances, where student background cao be assuaad to be unrelated to 
room assignment, only 15% (model 2.3) of the variance in student achiev«ent 
is associated with any differences between rooms. 

Fifteen percent isn't ouchy six percent is even less*-but these figures 
look like other estimates of the amount of variance in achievesiant that lies 
between school units. And, their sise is NOT a function of inadequate 
meaauree of e:eacher behavior. 

Finally, we note that about 581 of the variance in student achievenent 
Is associated with the student background measures, over aiyl ebove differences 
between rooms. Some 9% of the variance is associated with Joint effect of 
differences between rooms and student characteristics. In other words, in 
this sample it is impossible to disentangle a part of the background and 
rosn effects. 

A second step in the analysis involves substituting measures of teacher 
behavior which describe the rooms for the dummy variables wnich simply 
indicate in which room a student is located. CThe numbrr of descriptors 
should be lesj than the number of rooms If degrees of freedom are not to be 
exceeded.) To accoir^lish this, %fe used three measures of teacher behavior: 
carping criticism, teacher warmth and the extent to which the teacher extends 
freedom and autonomy t ;.he students. Onte aga^r. virlancc parr< Lonlng 
shows that a large amount of the variance in m&th <;vement is associated 
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Teble II 

Partitioning of Varitnce in Math Achievepent 
into Classroom and Background Related 
Sources - Year 1 

Pull Model Jwodel l.lj 72.98X 
Unique to Background /model 2.1 - nndel 2.3? 57.96X* 
Unique to Classrooms fpodd 2«1 - nodel 2.27 6«1AI^ 
Overlap 8.88X 



Partitioning of Variance in Math Achievepept 
into Teacher Behavior and Background 
Related Sources - Year 1 



Pull Model /model 2.5? 68.74X 

Unique to Background /model 2«5 model 2.4? 65.82X* 

Unique to Teacher Behavior /model 2.5 - model 2,2/ 1.90X 
Overlap 1.02X 



*p i .CI 
'*P i .05 
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vith background, over and above the aaasures of teacher behavior. About 2X 
la aasocianed vith teacher behavior over and above rooe effects. Only IX la 
shared betmen the two set^ of predictore. 

By compering nodel 2^3 and 2.4 we aee that while 15X of the variance in 
arth achieveoent lies between rooos, only 31 can be attributed to teaMtiTt 
behavior. Either these measures of ceacher behavior are not what cause the 
ditferetic^B in the outcone -or» the measures of behavior are inadequate* 
For the amount we can accept eith<*>r interpretation, for the finding is not 
as ioportant as the fact that we have outlined an easy way to assess the 
adequacy of our Mssures of teacher behavior. Modela 2«.l end 2.3 are a 
standard against which the measures can be evaluated; th<iy require no 
Msuaptions about what la being measured on the independent side of the 
regression equation. 

Substantively, we obtain the same kind of results when student 
satisfaction is used as the dependent variable (TAble III). Hot much 
variance is attributable to rooms, fully 30X is explained by the background 
variables, and there is some, but not muoh, overlap betv:.en rooms and 
background. Much less of the total variance is attributable to variables in 
the full model (38X against 73X for math). However, Figure I highlights an 
Important problem: the rooms which had high a«tlafactlon acores are not the 
same as those which had high oiath scores. (The rank-order correlation is 
.1308 (p^.05).) It seems probable, then, that activities that might lead 
to high math scores might not contribute to, or even reduce, satisfaction 
scrres. This observation represents a problem that requires extensive 
treatment In its own right. For now, we will proceed on the assumption that 
teachers are willing to maximize one output while perhaps seeking only to 
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Table 111 



Partitioning of Variance In Satisfaction with School 
into Classroom and Background Related ~ 
Sources - Year^ 



Full Model /model 2a7 38.66X 

Unique to Background /model 2.1 - niodel 2.3? 30.01X* 

Unique to Classrooo /model 2.1 - model 2.27 6.41% 

Overlap 2.24X 



Partitioning of Variance in Satisfaction with School 
into Teacher Sehavior and Background Related 
Sources ■ Year 1 

Full Model /w>del 2.57 34.49X 
Unique to Background /irodel 2.5 - model 2.4/ 25.84Z* 
Unique to Teacher Behavior /nodel 2.5 - model 2.27 2.24t 
Overlap 6.41X 



*P i .01 
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avoid serious probleaQB vith other outcome (s) that might be considered. In 
the interest of parsimony we vill confine our subsequent analyses to the math 
outputs. 

If the model uncovered by variance partitioning cannot be used on other 
sets of data, its practical significance is indeed limited. One way to 
examine the stability of the model is to compare equations derived from a 
second year of data collected with the same aample of students as they moved 
into the sixth grade. The relevant second year equations are 3.2, 3,4 end 
3.4 in Table IV. These contain information about background, teacher 
behavior in the second year in all three possible combinations. O^heir 
equivalents are models 2,2, 2.4 and 2,5 from the first year of data.) From 
a cor i^arison of Tables II and IV it is evident that the results of the 
variance partitioning (in math achievement) between these two sets of 
variables does not change substantially from the first year to the second. 
Aa F-test of the statistical significance of the difference in the amount of 
variance attributable to teach'ir behavior, and the background variables reveal 
that the differences from year one to year two are not statisticMily 
signiricanl at the .05 level. (See Table VI.) 

Conclus io n from the Variance Partitioning 

From all of the a^ove it seems that teac^.*r oehavlor, as measured In 
this study, has a trivial effect on both math achievement and satisfaction 
with school. Moreover, It does not seem likely that any measure of the 
classroom environment caa account for more than 15% of the variance In math 
achievement nor 87. of the variance in satisfaction with school. 
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Table IV 



Partitioning of Variance in Math Achievement 
into Classroom and Background Relat 
Sources Year 2 



Pull Model /model 3.l7 70.43% 

Unique to Background /model 3.1 - model 3.3? 58.261* 

Unique to Classrooms /model 3.1 - model 3.27 8.73%* 
Overlap 3.44% 



Partitioning of Variance in Math Achlevtment 
into Teacher Behavior and Background 
Related Sources - Year 2 

Full Model /Zodel 3.5/ 66.95% 

Unique to Background /nodel 3.5 - model 3.4? 62*49%* 

Unique to Teacher Behavior /model 3.5 - model 3.2? 5.25%* 

Overlap -.0079% 



*P < .01 
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Table V 

Partitioning of Varjance in Satisfaction with School 
Into Classroom and Background Related 
Sources - Year 2 

Pull Model /xodel 3.1/ 35.72X 
Unique to Background /model 3.1 - oxxlel 3.3? 20.35X* 
Unique to Classrooms /model 3.1 • suxiei 3.2? 11.17X** 
Overlap 4,20X 



Partitioning of Variance In Satisfaction with School 
into Teacher Behavior and Background Related 
Sources - Year 2 



Full Model /model 3.5? 32.04X 

Unique to Background /model 3.5 - model 3.4? 20. 5U* 

Unique to Teacher Behavior /model 3.5 - model 3.2? 7^49X* 

Overlap 



*p i .01 
**P i .05 



ERIC 



Ok 
I 



> 

JO 

m 

H 



C 

c 



CO 



fiC ^ 
.A 



>4 



5 



Oj V 

ax 



4)| 

5i 



«» 






u 






c 






« 




•n 


u 


o 


o 






• 




A 


A 


C 




o. 


bO 






















m 




SO 


o 






• <^ 




• • 


♦ 


o 










1 • 




S -P 


■o 






CM 


OS 








St \o 


• 




• 


• * 




•I • o 


in 


CM >D 












1 


i 


















ON 


u 






« 


» 


• 














• 








o 


«M 






00 




• 


• 








>- 




so 






T3 




O 


C2 










H > 


o 




• «o 








if 




u « 






« to 


o 




H 





ERIC 



.20- 



b) Parameter Estimation 

If we are willing to assume that our model of teacher behavior and 
student achievement it well specified, that the relevant variables have been 
Included in the model and that our measures are relatively accurate » ve are 
warranted In using regression analysis to generate the parameters of our 
model* A distinct advantage of using regression analysis in this manner lies 
In the interpretation of regression weights (the parameters or regression 
coefficients). For example, a regression weight of -.1790 attached to the 
first dimension of teacher behavior » carping criticism (Table VII, model 2.5) 
permits us to make the following statement: for every Increase of one point 
in the average student perception of teacher behavior (carping criticism) 
there is a decrease of .18 points in the student's post- test math achievement. 
Beta weights » which are nothing more than standardized regression coefficients, 
are open to a similar interpretation, except that a change in the outcome 
variable due to a predictor is reported in standard (x) scores. Except for 
the case when the predictor variables are orthogonal, we cannot generate 
equivalent statements by considering the unique and overlapping parts of the 
partitioned variance. 

Consider the needs of a district superintendent, faced with the problem 
of improving the academic achievement of the students in his various schools. 
He hires a consultant to advise him on the most promising course of action. 
The consultant collects a variety of measures pertaining to the organizational 
structure of the school, actual teacher behaviors, number of books per 
student, teacher salaries, and the number of remedial programs per x number 
of students In addition to data on student background characteristics. If 
the data is analyzed by partitioning the variance among the various factors. 
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the results will Indicate the xrplatlve iroortancc of the variables or sets 
of variables. The eatltnatton of the jarameters of the model, on the other 
hand, will provide, in addition, an estL-^ate of the expected fnctease In the 
outcome per standard unit Increase In a particular predictor variable. The 
fidminiatrator is then la a position to consider simultaneously the Investnant 
(in dollars- -or other terms) required to laanipulate the predictor variable 
and the expected Isaprovenent in thf o'^ncome given that investment. It may 
turn out, for example, that iilthougU the largest increase in the outcome 
measure can be expected as a lesult of Increasing, by one, the nunber of 
books per pupil, an even larger incretneat can be affected, for the ensm cost, 
by increasing five-fold the nuxnber of remedial reading programs per x nunber 
of students. 

There is a potential difficulty in working with regression wclshts 
which is -vidant fc^ren from oui example. When we employ a loeasure such as 
nuinber of books per pupil as a quality Indices for the cchool, it is possible 
that che -^a'jure is notbtng rroa than a p-oxy for the wealth of the schools, 
and by deTinition, the w^^alth (or SES) of the students. Unfortunately, by 
msnipulatirig the virlpble nuo^cr of books per pupil, we will probably not be 
able rn. af^ cv the dealrel outcome. This is an issue that Mood (1971) alludes 
no in his defense oi variance partttioniag as the appropriate strci^tlcal tool 
for analyziii^ the schooling f>roc'»sc;. 

An inter^sUn,^ and informative application of these protodurec would be 
to run inc rccr?s5l'"a equations (and estltaate the paramrters) separately for 
various group: of studcnc-i, For instance, if the researcher or practitioner 
believed ih^t the vari':u:> diraenaions of tep.cher behavior affected different 
lo.ial groups iiferently, he night construct two models, one for whites and 
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another for blacks. A comparison of the beta weights (for teacher behaviors) 
would indicate whether this hypothesis were, in fact^ tenable. 

Results 

Tables VII through X present the results of the parameter estimation 
for years one and two for the two outcomes, math achievement and satlsfactiua 
with school. 

Table VII, model 2.5, suggests that the pre^test measure is the oiost 
important predictor of post-test math achievement in year one. The other 
background variables make a comparatively small contribution to the outcome* 
(In the event that the reading pre^test measure were dropped from the 
equation, a variable such as IQ, which is highly correlated with th^ pre*test 
measure, would assume more importance.) Ihe teacher behavior measures: 
carping criticisir, teacher warnth and freedom or autonomy all make small 
negative contributions to the outcome. However, it Is not necessary to be 
overly concerned with these figures (which perhaps do not correspond to our 
expectations). The B weights for these variabiles are net aignif leant 
(p>.05), i.e,, more than five times out of a hundred we would obtain B 
weights such as these by chance. 

At this point, we are again faced with the problem cf evaluating the 
stability of our proposed model. If we simply examine the regression velghts 
attached to the variables In oodel 2.5 (year one. Table VII) and model 3.5 
(year two. Table IX), we see some rather dramatic differences. Vlhlle the 
pre-test measure is oace again the most Important variable In predicting the 
outcome in year two, the B coefficient Is smaller In year two than In year 
one. The B weights attached to sex and number of siblings have changed 
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direction. The oost noticeable changes, hoMver, have occurred. In the 
parametera associated with the three dlnenalons of teacher behavior; the 
size and direction of the B weights have changed substantially for all three 
neasures« 

Ve applied a test (Huacgt 1970) of the conatancy of a subset of 
regression coefficients (B weights) to the sieasures of teacher behavior 
predicting math achievement. We rejected the null hypothesis (Hq: Bj^«62) 
at the .01 level of significance (F - 9.68, d.f. - 3,354)* We applied the 
same test to the background variables; the null hypothesis (Hq: Bi,*B2) 
could not be rejected (P » 1.3363, d.f. - 6,354). 

In suDRDary, the B weights for teacher behavior changed significantly 
over the period in question. The background measures, on the other hand^ 
behaved consistently over the two sanples. We acknowledge that our 
interpretation of these F statistics la suspect--the neasureiaeQt instruments 
are relatively unsophisticated, making it extremely difficult to determine 
whether the change (and stability) we have verified statistically are, in 
fact, spurious. Regardless, we feel that the value of the procedure Is that 
it forces educational researchers to consider the issue of the stability of 
their proposed models. 

Sunanary and Conclusions 

In this report, we have attempted to sha# why it is necessary to devise 
models for examining the "causes" of students learning outcomes in ways which 
reflect the operation of 'xhools. In shorty we argue that it is necessary to 
use regression models which Incorporate both aggregate measures (school or 
classroom) and individual measures* We also try to show that the models may 
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be used In different ways, and that outcomes of research are highly 
dependent on the ways In which the regression models are used. 

In an earlier paper arising from this project (Anderson, 1972) the 
reasoning behind a mixed model of analysis was carefully spelled out and 
contrasting data analyses were presented. In this, the final report for the 
project, we have shown (a) how the regression equations may be used In two 
different ways, and (b) that the regrC5oion ^s^j^tions used to predict student 
outcomes seem unstable from year to year in terms of the coefficients applied 
to classroom behavior on the part of teachers, and (c) that differences 
between rooms in terms of student outcomes are much smaller than differences 
within rooms--again reinforcing the findings of Coleman et al. (1966), but 
with the significant difference that our unit of analysis was the classroom 
rather than the school. 

The li>tter two findings are important for the following reasons: 

(1) If regression coefficients for teacher behavior are unstable 
from year to year, then we cannot with safety apply 
sophisticated modeling techniques (such as path analysis) 

to data purporting to describe classroom behavior on the 
part of teachers. One would have to see stabiliiy from 
year to year in order to be confident that the results 
of an analysis based on coefficients would be worth 
acting upon from a policy standpoint. 

(2) If differences in student achievement lie primarily at the 
level of the individual student, then the primary focus of 
research activity aimed at Improving student performance 
needs to be on those things which have differential impact 
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on children in classrooms. Thus, masures of teacher or 
administrator behavior, while Important for their heuristic 
value at an aggregate level, need to be assessed from the 
vlewpoJnt of rach student If ve are to be able to exanln* 
the results of behavior on iitudent performance. 
Prom the above, we conclude that ouch of the research lato student 
behavior as a function of teacher performance l« without significant value. 
Both our unrestricted models (which show little variation in achievement 
attributable to room assignment, regardless of any characteristic of the 
teacher), and our restricted models (which attempt to assess student 
performance as a function of teacher behavior) indicate that little variance 
in pupil achievement can be ascribed to 'iifferences between rooms once student 
background characterldtlcs have been controlled. 
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